Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedback

An important goal in artificial intelligence is to create agents that can both interact naturally with humans and learn from their feedback. Here we demonstrate how to use reinforcement learning from human feedback (RLHF) to improve upon simulated, embodied agents trained to a base level of competency with imitation learning. First, we collected data of humans interacting with agents in a simulated 3D world. We then asked annotators to record moments where they believed that agents either progressed toward or regressed from their human-instructed goal. Using this annotation data we leveraged a novel method - which we call "Inter-temporal Bradley-Terry" (IBT) modelling - to build a reward model that captures human judgments. Agents trained to optimise rewards delivered from IBT reward models improved with respect to all of our metrics, including subsequent human judgment during live interactions with agents. Altogether our results demonstrate how one can successfully leverage human judgments to improve agent behaviour, allowing us to use reinforcement learning in complex, embodied domains without programmatic reward functions. Videos of agent behaviour may be found at https://youtu.be/v_Z9F2_eKk4

Non-Adherence in Patients on Peritoneal Dialysis: A Systematic Review

Background: It has been increasingly recognized that non-adherence is an important factor that determines the outcome of peritoneal dialysis (PD) therapy. There is therefore a need to establish the levels of non-adherence to different aspects of the PD regimen (dialysis procedures, medications, and dietary/fluid restrictions). Methods: A systematic review of peer-reviewed literature was performed in PubMed, PsycINFO and CINAHL databases using PRISMA guidelines in May 2013. Publications on non-adherence in PD were selected by two reviewers independently according to predefined inclusion and exclusion criteria. Relevant data on patient characteristics, measures, rates and factors associated with non-adherence were extracted. The quality of studies was also evaluated independently by two reviewers according to a revised version of the Effective Public Health Practice Project assessment tool. Results: The search retrieved 204 studies, of which a total of 25 studies met inclusion criteria. Reported rates of nonadherence varied across studies: 2.6 1353% for dialysis exchanges, 3.9 1385% for medication, and 14.4 1367% for diet/fluid restrictions. Methodological differences in measurement and definition of non-adherence underlie the observed variation. Factors associated with non-adherence that showed a degree of consistency were mostly socio-demographical, such as age, employment status, ethnicity, sex, and time period on PD treatment. Conclusion: Non-adherence to different dimensions of the dialysis regimen appears to be prevalent in PD patients. There is a need for further, high-quality research to explore these factors in more detail, with the aim of informing intervention designs to facilitate adherence in this patient populatio

Insecticidal and Attractant Activities of Magnolia citrata Leaf Essential Oil against Two Major Pests from Diptera: Aedes aegypti (Culicidae) and Ceratitis capitata (Tephritidae)

In this study, Magnolia citrata Noot and Chalermglin (Magnoliaceae) essential oil (MCEO) was evaluated for insecticidal activity against the yellow fever mosquito Aedes aegypti and attractant activity for the Mediterranean fruit fly Ceratitis capitata. The leaves of Magnolia citrata (Giổi chanh) were collected from northwestern Vietnam, and the water-distilled MCEO was analyzed by gas-chromatography and mass spectrometry (GC-MS). The major constituents of MCEO were identified as linalool 19%, geranial 16%, citronellal 14%, neral 14%, and sabinene 12%. MCEO showed 100% mortality at 1 μg/μL against 1st instar larvae of Ae. aegypti (Orlando strain, ORL), and the oil exhibited 54% (ORL) and 68% (Puerto Rico strain) mortality at 5 μg/mosquito against Ae. aegypti adult females. Initial screens showed that MCEO had weak insecticidal activity compared to the positive control permethrin. In bioassays with sterile male C. capitata, MCEO exhibited moderately strong attraction, comparable to that observed with a positive control, Tetradenia riparia essential oil (TREO). Herein, the insecticidal and attractant activities of MCEO are reported for the first time

Evaluating the Impact of Language Concordance on Coronavirus Disease 2019 Contact Tracing Outcomes Among Spanish-Speaking Adults in San Francisco Between June and November 2020.

We evaluated the impact of language concordance-clinician or public health worker fluency in a patient's primary language-on coronavirus disease 2019 (COVID-19) contact tracing outcomes among 2668 Spanish-speaking adults in San Francisco. Language concordance was associated with 20% greater odds of COVID-19 testing and 53% greater odds of support service referrals

The Virgin Mary With a Mobile Phone: Ideologies of Mothering and Technology Consumption in Philippine Television Advertisements

In the Philippines, mobile phones are actively used across the population, including the large numbers of Filipino citizens working abroad, a majority of them women. This article investigates how television advertising of mobile phones engages culturally relevant roles of mothers to attract women as technology consumers. Using semiotic analysis, the article explores how these promotional messages perpetuate mothering ideologies and propose how best to harness communication technologies in the service of motherhood in this glocal setting. Within a predominantly Catholic and Marian nation, images of the efficient, nurturing, and self-sacrificial mother should not be viewed as benign or power-neutral. Strategies to increase market share in an increasingly competitive sector perpetuate multiple subjectivities. © 2014 International Communication Associatio